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STREAM SWITCH FABRIC 

FTKT.D OF THE INVENTION 

5 The present invention relates generally to the field of stream data and, 

more specifically, to processing of stream data within a stream switch fabric. 

BACKGROUND OF THE INVENTION 

10 A packet switched network is one in which data is commurucated as 

discrete packets, each packet containing a header. The header contains 
information regarding the packet's source, ultimate destination, etc. For 
instance, in the case of a Transmission Conhrol Protocol (TCP) /Internet 
Protocol(IP) packet, the header includes the IP source address, TCP source port, 

15 the IP destination address and the TCP destination port. Each packet is 

individually transmitted to its ultimate destination through a series of network 
switches (bridges, IP switches, IP routers, layer 4 load balancers, etc.). Most 
network switches examine the header to determine the packet's ultimate 
destination, and the network switch decides how to forward the packet based on 

20 this header information. A network switch that operates in this manner remains 
"ignorant" of the packet content since the actual content of the packet is 
irrelevant in making forwarding decisions. 

Recently, network switches (e.g. bridges, IP switches, IP routers, layer 4 
25 load balancers, etc.) have emerged, which are "content aware". These types of 
switches are often referred to as "content switches". Content switches are 
embedded with specific knowledge of, and monitor or participate in, the upper 
layer protocols (e.g., HTTP etc.). Content switches examine and sometimes 
modify the packets of data tiransmitted through the network. These content 
30 switches are typically designed aroxxnd a packet-oriented switch fabric similar to 
the way bridges, IP routers and layer 4 load balancers are designed. In some 
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instances, content switches may also perform bridging, routing and load 
balancing functions. 

Conventional content switches have been made content aware only for 
5 applications that are popular and that will benefit from content aware switching 
or processing. These applications have been and likely will continue to be 
stream-oriented applications. A stream is a series of bytes transferred from one 
application to another and stream-oriented applications create or manipulate 
data as streams of bytes. In the case of a stream being transmitted within a 

10 packet switched network, the stream of data is divided and transmitted via a 
flow of packets, a flow of packets being a bidirectional set of packets going 
between two end points within two end stations. At the application end points. 
Streams of bytes are passed through layer 4 processing, such as a TCP layer. On 
behalf of the sending application, the layer 4 processing divides the data stream 

15 arbitrarily into segments, applies a segment header to identify the stream and 
the relative order of the data, and applies a layer 3 header such as an IP header. 
On behalf of the receiving application, the layer 4 processing re-orders mis- 
ordered segments, requests retransmission of lost packets and reconstitutes the 
byte stream. It is noted that it is possible for packet switched networks to mis- 

20 order and/ or lose packets. 

One problem with the current design of content switches is that as 
content switching and content modification become more sophisticated, the 
ability to perform fvmctions on a packet by packet basis will become awkward, 
25 inefficient and virtually impossible. Thus, there will be the need for the content 
switch to reconstitute the original data stream and re-segment it, this 
functionality being referred to as a layer 4 proxy function (for example a TCP 
proxy function). 

30 As content functions become more sophisticated and processing 

intensive, a content switch will need to distribute the processing among 
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processing elements within the switch to become faster and more efficient. 
These processing elements may be identical and simply load share the work or 
they may be optimized for certain applications or portions of applications. 
Connecting these processing elements with a packet fabric will require that the 
5 layer 4 proxy function be performed by or next to each processing element. 

The location of the layer 4 proxy function next to each processing 
element, however, is less than optimal because some applications may only 
determine the most appropriate processing entity by examining the content and 
10 because some applications may require multiple processing elements to perform 
content hmctions on a data stream in series. In these cases, the proxy function 
would be done more times than necessary and the stream would be transmitted 
more times than necessary. 

15 It would thus be beneficial to provide a fabric, which would 

manage/switch data streams, allowing the layer 4 proxy function to be more 
appropriately placed and performed less often. 

SUMMARY OF THE INVENTION 

20 

The present invention is directed to apparatus and method for processing 
data streams within a stream switch fabric. In embodiments of a stream switch 
fabric according to the present invention, at least one stream queue is coupled to 
a stream queue controller. A producer operates to output properly ordered 

25 portions of a data stream, hereinafter referred to as substreams, to the stream 
queue. Subsequently, the stream queue controller operates to control the 
outputting of a portion of the data within the stream queue to a consumer of the 
stream queue. In embodiments of the present invention, the stream queue 
controller can initiate further actions within the stream queue such as copying a 

30 portion of the data within the stream queue to a content processing element for 
analysis; redirecting the data within the stream queue to another consumer of 
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the data stream, such as another processing element or an interface with a 
packet switched network; modifying a portion of the data within the stream 
queue; and/or transferring a portion of the data within the stream queue to 
another stream queue within the stream switch fabric. In some embodiments of 
5 the present invention, the stream queue is controlled by control signals being 
received from an external element such as the consumer of the stream queue. 

According to a first broad aspect, the present invention is a stream switch 
fabric including at least one stream queue and a stream queue controller 
10 coupled to the at least one stream queue. The stream queue operates to receive 
and store a plurality of properly ordered substreams of a data stream from a 
producer of the data stream and the stream queue controller operates to control 
outputting of at least a portion of the data within the at least one stream queue 
to a consumer of the stream queue. 

15 

In some embodiments of the present invention, the stream queue 
controller further operates to receive a control signal associated with the stream 
queue. In these cases, the control signal could be an indication of at least one 
consumer attribute for the at least one stream queue, such as the actual 

20 consumer that is assigned as the consumer of the stream queue or the number of 
bytes of the data within the stream queue that are to be output to the consumer 
of the stream queue. Further, the control signal could be an instruction to 
trigger copying of at least a portion of the data within the stream queue to the 
consumer of the stream queue, an instruction to trigger forwarding of at least a 

25 portion of the data within the stream queue to the consumer of the stream queue 
and deleting of this portion of the data within the stream queue, or another such 
trigger instruction. 



30 



According to a second broad aspect, the present invention is a stream 
switch fabric including reception means for receiving a plurality of properly 
ordered substreams of a data stream from a producer of the data stream; storage 
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means for storing the substr earns; and control means for controlling outputting 
of at least a portion of the data within the means for storing the substreams to a 
consumer of the data stream. 

According to a third broad aspect, the present invention is a method of 
processing streams of data. The method includes receiving properly ordered 
substreams of a data stream; storing the substreams within a stream queue 
associated with the data stream; and outputting at least a portion of the data 
within the stream queue to a consumer of the stream queue. 

Other aspects and advantageous features of the present invention will 
become apparent to those ordinarily skilled in the art upon review of the 
following description of specific embodiments of the invention in conjimction 
with the accompanying figures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be more clearly understood by reference to the 
following detailed description of an exemplary embodiment in conjunction with 
the accompanying drawings, in which: 

Figure 1 illustrates a flow chart of a set of steps performed by an initiator 
of a new stream queue according to the present invention; 

25 Figure 2 illustrates a simplified block diagram of a stream processing 

node according to an embodiment of the present invention; 

Figure 3 illustrates a flow chart of a set of broad steps performed within a 
stream processing node according to an embodiment of the present invention; 

30 

Figure 4 illustrates a simplified block diagram of a stream processing 
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node with an I/O element coupled to a packet switched network according to 
an enabodiment of the present invention; 

Figure 5 illustrates a logical block diagram of a sample implementation of 
5 the stream processing node of Figure 4 in a packet switched network; 

Figure 6 illustrates a detailed block diagram of the stream processing 
node of Figure 4 according to an embodiment of the present invention; 

Figure 7 illustrates the block diagram of Figure 6 with the signalling 
depicted for one particular sample operation; 

Figure 8 illustrates a flow chart of a set of steps performed by an 
Input/Output (I/O) element as a producer for a stream queue according to an 
embodiment of the present invention; 

Figure 9 illustrates a flow chart of a set of steps performed by a content 
processing element within a stream processing node according to an 
embodiment of the present invention; 
20 

Figure 10 illustrates a flow chart of a set of steps performed by an 1/ O 
element as a consumer for a stream queue according to an embodiment of the 
present invention; 

25 Figure 11 illustrates the block diagram of Figure 6 with the signalling 

depicted for another particular sample operation; 




30 



Figure 12 illustrates a flow chart of a set of steps performed by a 
decryption processing element within a stream processing node according to the 
present invention; and 
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Figure 13 illustrates a block diagram of an alternative stream processing 
node to that illustrated in Figure 6. 

DETAILED DESCRIPTION OF THE INVENTION 

5 

The present invention provides a method and apparatus for content 
based decision making for forwarding/ processing data streams. Within 
embodiments of the present invention, properly ordered portions of data 
streams, hereinafter referred to as substreams, are input to stream queues within 

10 a stream fabric; stream queues being data structures that store continuous 
subsets of data streams while they await processing or transmitting. Each 
stream queue has an assigned producer and an assigned consumer, each of 
which have set controls over the stream queue. For instance, in one 
embodiment, the producer of the stream queue can push substreams and/or 

15 control information onto the stream queue while the consumer of the stream 
queue can request to pop portions of the data from the stream queue to the 
consumer, to copy portions of the data from the stream queue to the consiuner, 
to transfer portions of data from the stream queue to another stream queue, and 
to push data and/or control information onto the stream queue. Further, the 

20 consumer can request the stream fabric to adjust the consumer attributes such as 
to change the consumer that is to control the stream queue and /or change the 
number of bytes transferred to the consumer during a pop/ copy. The changing 
of the actual consumer is hereinafter referred to as rescheduling of the stream 
queue. 

25 

Figure 1 illustrates a flow chart of a set of steps performed by an initiator 
of a new stream queue according to an embodiment of the present invention. A 
new stream queue might need to be initiated in the case that a new stream of 
data enters the stream fabric, such as a new stream from a packet switched 
30 network. In one embodiment, the initial rights of the producer and consumer 

are set to the initiator of the new stream queue as depicted in step 102. Next, the 



8 File No. 14174ROUS02U 

initiator of the new stream queue sets the priority of the stream queue relative to 
other stream queues within the stream fabric at step 104 and sets the criteria for 
the first pop /copy of data from the stream queue at step 106. Finally, at step 
108, the initiator of the stream queue sets the initial consumer of the stream 
5 queue at step 106 by requesting a change in the consumer attributes for the 

stream queue, thus rescheduling the stream queue. This first rescheduling of the 
stream queue in many embodiments is done to direct the first copy of the data 
within the stream queue to a default processor that will always receive the right 
to consume the stream, such as a content processing element. In other 

10 embodiments, the initial consumer of the stream queue could be determined on 
a round robin basis, or on some other basis. Further, the initial consumer could 
be a set of possible consumers wherein the least burdened of the set, or the 
consumer in the set with the highest priority receives the initial right to consume 
the stream queue. Those skilled in the art will recognize that there are many 

15 variations for determining the initial consumer of the stream queue and that 
each of these variations will fall within the scope of the invention. It should 
further be understood that the above steps for initiating a stream queue could be 
performed in a different order. 

20 Figure 2 illustrates a simplified block diagram of a stream processing 

node according to an embodiment of the present invention. As depicted, stream 
processing node 50 comprises a producer of a stream of data 60 (hereinafter 
referred to as a producer), a content processing element 80, a consumer of a 
stream of data 90 (hereinafter referred to as a consumer) and a stream fabric 70 

25 coupled between the other elements 60,80,90. Each of the producer and 

consimier 60,90 could be an Input/Output (I/O) element, a processing element, 
a computer, a memory device, a storage device, a cache device or another device 
that can produce and/or consume a data stream. 

30 The stream fabric 70, as depicted in Figure 1, comprises a stream queue 

controller 72 and a set of stream queue(s) 74; the stream queue(s) 74, as 
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described above, being data structures that store continuous subsets of data 
streams while they await processing or transmitting. The stream queue(s) 74 
may be one or more buffers, registers and/ or any other type of temporary 
storage devices. The stream queue(s) 74 may be hierarchical. The stream queue 
5 controller 72 controls the stream queue(s) 74 as will be described in detail herein 
below. Although only one stream queue controller 72 is illustrated for ease of 
explanation, it should be recognized that more than one could be implemented 
within the stream fabric 70. The stream queue controller 72 may be an 
application specific integrated circuit (ASIC), a reduced instruction set computer 
10 (RISC) processor, a complex instruction set computer (CISC) processor, a digital 
signal processor (DSP) or another processing element. 

Although component 60 is labelled as a producer of a stream of data and 
component 90 is labelled as a consumer of a stream of data, it should be 

15 understood that the producer 60 could also operate as a consumer of a stream of 
data and the consumer 90 could operate as a producer of a stream of data. This 
is illustrated in detailed examples described herein below in which producer 60 
is an Input/Output (I/O) element and the consumer 90 is a processing element. 
Further, it should be understood that the content processing element could be 

20 considered an initial consvimer of streams of data. Yet further, although only a 
single producer 60, a single consumer 90 and a single content processing 
element 80 is shown, a plurality of one or more of these elements could be 
implemented in a stream processing node according to the present invention. 

25 Figure 3 illustrates a flow chart of the broad steps performed within the 

stream processing node 50 according to an embodiment of the present 
invention. Firstly, at step 200, the producer 60 pushes properly ordered 
portions of a stream of data (substreams) to a stream queue 74 within the stream 
fabric 70. The producer 60 could have acquired the stream of data from many 

30 different sources including an internal memory source, an internal processing 
element and/or an external component or network. For instance, in the case 
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that the producer is an I/O element, the producer 60 might have received a 
stream of data (voice, data, video, etc.) segmented within a series of data packets 
from a packet switched network. In this case, the producer 60 would classify the 
received packets into separate streams, reconstitute substreams of the data 
5 within the packets and push the reconstituted substreams to a stream queue 74 
within the stream fabric 70. 

Next, as depicted at step 300 of Figure 3, a copy of the leading portion of 
the data within the stream queue 74 is forwarded to the content processing 

10 element 80. This is followed at step 400 by the content processing element 80 
processing the content in the leading portion of the data within the stream 
queue and, based upon this content, deciding what to do with the particular 
stream. For instance, as described below in more detail, the content processing 
element 80 could decide to: consume the stream (i.e. pop and process all data 

15 received at the stream queue), consume a portion of the stream (i.e. pop and 
process a portion of the data received at the stream queue), add data to the 
stream (i.e. push data to the stream queue), delete data from the stream (i.e. 
simply pop data from the stream queue and disregard it), change data in the 
stream (i.e. pop data from the stream queue and push modified data back onto 

20 the stream queue), redirect the right to consume the stream to another potential 
consumer (i.e. change the consumer attributes for the stream queue), request 
more data from the stream queue 74 (i.e. copy a further portion of the data from 
the stream queue), transfer data from the stream queue 74 to another stream 
queue (i.e. pop a portion of the data on the stream fabric and push this data onto 

25 another stream queue) etc. The content processing element 80 then sends 

instructions to the stream queue controller 72 indicating the decision that was 
made. For instance, if the content processing element 80 decides to consume the 
stream then it instructs the stream queue controller 72 to push portions of the 
data in the stream queue 74 to that processing element. If the content processing 

30 element 80 decides to reroute the stream, it instructs the stream queue controller 
72 which consumer should have the right to consume the data within the 
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particular stream queue 74. 

Subsequently, as depicted at step 500, the stream queue controller 72 
performs the copy, pop, push, reschedule and/ or transfer operation on the 
5 stream queue 74 as requested, each of these fimctions described by example in 
more detail herein below. Finally, if the stream queue controller 72 reschedules 
the stream queue to another consumer, such as the consumer 90 of Figure 1, or 
essentially continues to assign itself as the consumer by selecting to pop data 
from the stream queue, the data within the stream queue is processed by the 
10 consumer as required at step 600. At this point, the results from the processing 
of the data stream may be output from the stream processing node, saved within 
the stream processing node or output back within a second stream queue within 
the stream fabric 70. In this last case, the consumer is essentially the producer of 
the second stream queue and possibly the initiator of this second stream queue. 

15 

Figure 4 illustrates a simplified block diagram of a stream processing 
node with an I/O element coupled to a packet switched network according to 
an embodiment of the present invention. In this embodiment, the producer 60 
of Figure 2 is an I/O element which receives data packet flows from a packet 

20 switched network and outputs properly ordered substreams of the data streams 
to respective stream queues within the stieam fabric 70. The processing element 
90 could be utilized as a consixmer of the data streams if it is deemed necessary 
to perform processing on any of the data within the stream queues of the stream 
fabric 70. Further, as wHl be described herein below in detail, the I/O element 

25 60 could be utilized as a consumer of data streams if any of the data streams 
must be routed back onto the packet switched network and the processing 
elements 80,90 could be utilized as producers of data streams if, after processing 
a data stream or a portion of a data stieam, substreams of a new or modified 
data stream are output to a new stream queue within the stream fabric 70. 

30 

It should be understood that, although Figure 4 shows only one I/O 
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element 60, one content processing element 80 and one processing element 90, it 
should be understood that there may be any nximber of I/O elements, content 
processing elements, processing elements and/ or other producer and consumer 
components within the stream processing node. 

5 

Figure 5 illustrates a logical block diagram of a sample implementation of 
the stream processing node 50 of Figure 4 in a packet switched network. As 
depicted, a first client 120 is communicating with a second client 130 via the 
stream processing node 50 utilizing a layer 4 protocol such as TCP. In this case, 

10 the first client 120 is coupled to the packet switched network via a layer 4 socket 
122 and a layer 4 port 124 and the second client 130 is coupled to the packet 
switched network via a layer 4 socket 132 and a layer 4 port 134. The 1/ O 
element 60 within the stream processing node 50, as depicted in Figure 4, is 
logically comprised of a layer 4 socket 142 coupled to the stream fabric 70 and a 

15 layer 4 port 144 coupled between the layer 4 socket 142 and the packet switched 
network. 

In this case, a stream of data output from the first client 120 is segmented 
by the layer 4 socket 122 and the segments of the stream are output as data 

20 packets with layer 3 and layer 4 headers (such as TCP and IP headers) from the 
layer 4 port 124. The layer 4 port 144 along with the layer 4 socket 142 operate 
to receive the data packets transmitted from the layer 4 port 124 and reconstitute 
the data stream output from the first client 120. The reconstitution of the data 
stream is done with well-known layer 4 protocol techniques including removing 

25 the packet overheads from the packets, re-ordering the data within the packets 
into the correct order and requesting the retransmission of any packets that 
were lost. The layer 4 socket 142 then forwards substreams of the data stream to 
the stream fabric 70. In the case that the stream processing node 50 determines 
that the data stream is to be forwarded to the second client (possibly due to an 

30 HTTP address within the content of the data stream), the stream fabric 70 

outputs portions of the stream to the layer 4 socket 142 which along with the 
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layer 4 port 144, segments the stream data and outputs packets including the 
segmented data and layer 3 and layer 4 headers to the layer 4 port 134. Similar 
to the above described operation for the layer 4 port 144 and layer 4 socket 142, 
the layer 4 port 134 and layer 4 socket 132 proceed to receive the packets of the 
5 data stream, reconstitute the data stream and output the data stream to the 
second client 130. 

It should be recognized that although the above description is specific to 
commimications from the first client 120 to the second client 130, 
10 communications could further be directed in the opposite direction or other 
clients could be included within the system. Further, it should be understood 
that the bidirectional commimications between the layer 4 ports 124,144 could 
be considered a flow of packets while the bidirectional communications between 
the layer 4 ports 144,134 could further be considered a flow of packets. 

15 

Figure 6 illustrates a detailed block diagram of the stream processing 
node 50 of Figure 4 according to an embodiment of the present invention. This 
implementation of the stream processing node 50 could be utilized within the 
example described above with reference to Figiire 5. As depicted, the stream 

20 processing node of Figure 6 comprises I/O element 60, stream fabric 70, content 
processing element 80 and processing elements 90,100 which correspond to first 
and second application processing elements respectively. It should be 
imder stood that other I/O elements and /or processing elements could also be 
included within the stream processing node 50 of Figure 6. Further, although 

25 the stream fabric 70 is depicted with four stream queues 74, other numbers of 
stream queues could be implemented. 

As illustrated in Figure 6, the I/O element 60 comprises a processor 62 
that includes a flow classification block 64, a layer 4 termination block 66 and a 
30 layer 4 segmentation block 68 which together are logically equivalent to the 

layer 4 port 144 and layer 4 socket 142 of Figure 5. The flow classification block 
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62 classifies packets received from a packet switched network into separate 
flows of packets based upon the flow identifiers attached to the packets, the flow 
identifiers including the source layer 3 address, the source layer 4 port, the 
destination layer 3 address, the destination layer 4 port and the layer 4 identifier 
5 (i.e. UDP or TCP etc.). Each flow of packets corresponds to a different stream of 
data. The layer 4 termination block 66 performs well-known reconstituting of 
the data stream by removing the packet overhead from the data, re-ordering the 
data within the received packets and requesting re-transmissions of packets that 
have been lost. The output from the layer 4 termination block 66 are substreams 
10 including correctly ordered portions of the overall data stream. The layer 4 
segmentation block 68 performs well-known segmentation operations of 
incoming data from the stream fabric 70 and outputs packets including the 
segmented data along with layer 3 and layer 4 headers to a packet switched 
network. 

15 

The operation of the stream processing node 50 of Figure 6 will now be 
described for one particular scenario with reference to Figures 7 through 10. In 
this scenario, a data stream arrives at the I/O element 60 and has an indication 
within its content of where the data stream should be ultimately forwarded. For 
20 example, the content could include an HTTP address that indicates the 

appropriate location for the stream processing node to route the particular data 
stream. Figure 7 illustrates the block diagram of Figure 6 with the signalling 
depicted for this scenario. 

25 As illustrated in Figure 7, a flow of data packets, as indicated by signal 

702, is received at the I/O element 60 and a series of substreams of the data 
stream contained within the received data packets is subsequently output to a 
stream queue (in this case SQ2) within the stream fabric 70 as indicated by signal 
704. In this case, the I/O element 60 is the producer of the stream queue SQ2. 

30 



Figure 8 illustrates a flow chart of a set of steps performed by an I/O 
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element as a producer for a stream queue according to an embodiment of the 
present invention. Firstly, the I/O element receives a flow of data packets at 
Step 202. These packets may represent a single segmented data stream from a 
single sender, many segmented data streams from many senders, or many 
5 segmented data streams from a single sender. For example, an 1/ O element 

may receive 100 IP packets which represent a single data stream made up of 100 
packets, or multiple data streams each made up of fewer than 100 packets. 

Next, at step 204, the I/O element reads the flow identifiers of the packets 
10 within the flow at step 204. As described above, the flow identifiers include the 
packets' source layer 3 address, source layer 4 port, destination layer 3 address, 
destination layer 4 port and a layer 4 identifier (i.e. UDP or TCP etc.). Each flow 
identifier is imique to a particular data stream. Therefore, the I/O element can 
group the received data packets based upon the data stream which they are 
15 associated with by grouping the packets with identical flow identifiers. 

Next, the I/O element terminates the layer 4 protocol for the packets 
using well-known techniques at step 206. This termination of the layer 4 
protocol includes removing packet overhead such as the layer 3 and layer 4 
20 headers from the data, re-ordering the data into the proper order as necessary 
and requesting retransmission of any packets that are found to be lost or 
delayed beyond a threshold level. The result of the termination of the layer 4 
protocol is the reconstitution of data streams or at least portions of the data 
streams within the I/O element. 

25 

Finally, at step 208, the I/O element pushes properly ordered substreams 
of data bytes to corresponding stream queues. If no stream queue has yet been 
assigned for a particular received stream, the I/O element preferably goes 
through an initiation procedtire such as that described above with reference to 
30 Figure 1. 
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Now returning to Figure 7, the substreams 704 output from the I/O 
element 60 are received at a stream queue 74 (SQ2 in Figure 7). Once the data 
stream is at least partially received by the stream queue 74, a copy of a portion 
of the data within the stream queue is forwarded to the initial consumer of the 
5 stream queue as indicated by the signal 706, the initial consumer being the 
content processing element 80 in the scenario of Figure 7. The stream queue 
controller 72 then waits for instructions from the content processing element 80. 

Figure 9 illustrates a flow chart of a set of steps performed by a content 
10 processing element within a stream processing node according to an 

embodiment of the present invention. Firstly, the content processing element 
receives a portion of a data stream at step 402. Next, it determines if the portion 
is sufficient to analyse the stream at step 404. It might not be a sufficient portion 
of the stream in many instances such as in the case that the content processing 
15 element has not yet received a complete HTTP address to indicate proper 

routing of the data stream. If there is not a sufficient portion of the data stream 
to analyse, the content processing element requests, at step 406, for an additional 
copy operation to be performed such that an additional portion of the data 
within the stream queue is copied to the content processing element. Next, the 
20 content processing element processes the content within the data that it has 
received at step 408. Three possible conclusions of many from the analysis 
could be that a URL is detected as depicted at step 410, an intermittent 
processing is determined to be required at step 422 and encrypted data is 
detected at step 426. 

25 

If a URL is detected at step 410, the content processing element 
determines if a URL translation is required at step 412. In some embodiments of 
the present invention, the content processing element includes a URL translation 
table. If a URL is detected that is included within the table, a translation of the 
30 URL is required. One skilled in the art could conceive of other cases in which a 
translation in the URL would be required as well. 
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If no translation is required, the content processing element pushes a flow 
context ID to the stream queue at step 414. The flow context ID is a number that 
indicates to an I/O element that later processes the data stream which flow 
5 within the packet switched network to output the data stream. In the case that 
no previous data stream has been assigned the particular flow that the content 
processing element determines is necessary to properly route the data stream, 
the content processing element preferably pushes a flow context ID that includes 
the required layer 3 destination address and the layer 4 destination port for the 
10 data stream. With this information, an I/O element can produce a flow 

identifier for the packets of that required flow which can preferably later be 
accessed with use of an assigned flow context ID number. Finally, after pushing 
the flow context ID to the stream queue, the content processing element, at step 
416, requests rescheduling of the stream queue to the proper 1/ O element. 

15 

If at step 412 it is determined that the URL requires a translation, the 
content processing element requests a pop of the original URL data from the 
stream queue at step 418. Once the content processing element receives the pop 
of the original URL, the content processing element pushes, at step 420, the 
20 translated URL to the stream queue to replace the original URL. Once 

completed, the content processing element continues to proceed with the steps 
414 and 416 described herein above. 

If an intermittent processing is required as detected at step 422, the 
25 content processing element requests a transfer of a set number of bytes from the 
first stream queue to a second stream queue at step 424. This intermittent 
processing could be required in cases that the content processing element can 
determine how to properly proceed with only a portion of the data stream or if 
the content processing element determines that a change within the data stream 
30 is required intermittently. This could occur for example in cases that a URL 
must be translated periodically during a single data stream. Once, the set 
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number of bytes are transferred, the content processing element returns to step 
402 of the flow chart of Figure 9. 

If encrypted data is detected at step 426, the content processing element 
5 requests rescheduling of the stream queue to a decryption engine, such as an 
SSL engine, at step 428. 

The particular scenario being depicted within Figure 7 is consistent with 
the content processing element detecting a URL within the data stream at step 

10 410 and proceeding through steps 412, 414 and 416 of Figure 9. Therefore, as 
depicted in Figure 7, the result of the content processing element 80 detecting a 
URL within the data stream is the sending of a request for rescheduling of the 
stream queue SQ2 to the 1/ O element 60 and an indication for a pop to be 
irutiated to the I/O element 60, as indicated by the signal 708 between the 

15 content processing element 80 and the stream queue controller 72. The result of 
this request is the stream queue controller changing the consumer attributes 
associated with the stream queue SQ2 such that the consumer rights belong to 
the 1/ O element 60. In this particular case, the producer and consumer of the 
stream queue SQ2 are both the I/O element 60, though it should be understood 

20 that the content processing element could have requested the rescheduling of 
the stream queue to another I/O element. Next, the stream queue controller 72 
initiates a pop of data from the stream queue SQ2 to the new consumer, I/O 
element 60 as indicated by signal 710, and the I/O element 60 consumes the data 
within the stream queue SQ2. 

25 

Figure 10 illustrates a flow chart of a set of steps performed by an I/O 
element as a consumer of a data stream according to an embodiment of the 
present invention. Initially, the 1/ O element receives a pop of a portion of a 
stream from a stream queue at step 602 and analyses the flow context ID 
30 provided by the content processing element to identify a flow identifier for the 
particular stream at step 604. If the flow context ID is simply an assigned 
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number for a particular flow, the I/O element looks up the flow identifier from 
a flow identifier table. If the flow context ID includes a layer 3 destination 
address and layer 4 destination port, the I/O element generates a new flow 
identifier with this information along with known information with respect to 
5 the layer 4 ports that are available within the I/O element. 

Next, the I/O element segments the stream based upon a layer 4 protocol 
at step 606, attaches layer 3 and layer 4 headers to the segmented portions of the 
stream at step 608, and outputs, at step 610, flows of data packets that 
10 correspond to the segmented portions of the data stream via the appropriate 
layer 4 port. At this point, the I/O element requests an additional pop of a 
portion of the data within the stream queue at step 612. After receiving the 
additional pop from the stream queue at step 614, the I/O element returns to 
step 606 within the procedure described above. 

15 

Within Figure 7, the result of the I/O element consuming the data stream 
is the outputting of data packets 712 to the packet switched network. 

Figure 11 illustrates the block diagram of Figure 6 with the signalling 
20 depicted for a scenario in which encrypted data is detected within the data 

stream by the content processing element 80. In this case, the operation of the 
stream processing node 50 is identical to that described above for Figure 7 until 
the content processing element has completed its analysis of the copied portion 
of the stream queue SQ2. In this case, the content processing element 80 
25 determines that the data within the stream is encrypted and, as indicated by 

signal 714, requests rescheduling of the stream queue SQ2 to the first application 
processing element 90, which in this scenario has a decryption algorithm and 
therefore is a decryption processing element. The stream queue controller 72 
then modifies the consumer attributes for the stream queue SQ2 such that the 
30 consumer is set as the application processing element 90 and initiates a pop of 
data from the stream queue SQ2 to the processing element 90 as indicated by 
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signal 716. 

Figure 12 illustrates a flow chart of a set of steps performed by a 
decryption processing element within a stream processing node according to the 
5 present invention. Firstly, the decryption processing element receives a pop of a 
portion of the data within a stream queue at step 616. Next, the decryption 
processing element performs decryption procedures on this data at step 618 and 
pushes the decrypted substreams of a new data stream to a second stream queue 
within the stream fabric at step 620. Initially, the decryption processing element 
10 likely would need to initiate the second stream queue as indicated in the 

description of Figure 1. Finally, the decryption processing element requests an 
additional pop of a portion of the data within the first stream queue at step 622 
and then proceeds to return to step 616 described herein above. 

15 Turning to Figure 11, the application processing element 90, acting as a 

decryption processing element, receives portions of the data within stream 
queue SQ2 and outputs decrypted versions of the data stream into stream queue 
SQ3 as indicated by signal 718. In this scenario, the application processing 
element 90 initiated the stream queue SQ3 such that the irutial consumer was 

20 chosen to be the content processing element 80. In this case, as described 
previously, a copy of the data within the stream queue SQ3 is copied to the 
content processing element 80 as indicated by signal 720. After analysing this 
data, the content processing element 80 then sends instructions to the stream 
queue controller by signal 714. In the scenario depicted in Figure 11, the content 

25 processing element 80 determines the decrypted data stream includes a URL 
that should be used to properly route the data stream similar to the scenario of 
Figure 7. This results in the rescheduling of the stream queue SQ3 to the I/O 
element 60, the popping of portions of the data within the stream queue SQ3 to 
the I/O element 60 as indicated by signal 722 and the eventual outputting of 

30 packets 724 corresponding to the decrypted data stream to the packet switched 
network. 
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It should be imderstood that in an alternative scenario, the content 
processing element 80, after determining the URL of the decrypted data stream, 
could have requested that the data within the stream queue SQ3 be re-encrypted 
5 prior to being rescheduled to the I/O element 60 for outputting. This could 

have been accomplished by rescheduling the stream queue SQ3 to an encryption 
processing element and initiating a third stream queue with the rights of the 
consumer and producer of this new stream queue being the I/O element 60 and 
the encryption processing element respectively. It should be understood that 
10 other techniques for re-encrypting the data stream could also be utilized. 

Although the present invention is primarily described herein above for 
an implementation within a packet switched network, it should be understood 
that the scope of the present invention should not be limited to this 

15 implementation. It should be noted that the present invention could be used as 
the basis for switches, routers, bridges, servers, firewalls, load balancers, cache 
farms, etc. For instance. Figure 13 illustrates a block diagram of an alternative 
stream processing node to that illustrated in Figure 6 in which the 1/ O element 
60 is replaced by a memory cache 150. In this case, the memory cache 150 could 

20 be utilized as a producer and /or a consumer for a stream queue within the 
stream fabric 70. It should be imderstood that a plurality of memory cache 
could be implemented in a stream processing node according to the present 
invention, possibly with no other processing elements but the content 
processing element 80. 

25 

It should be understood that embodiments of the stream processing node 
according to the present invention as described above could be implemented 
within one or more separate computer chips. For instance, in one 
implementation, an I/O element, a stream fabric and a plurality of processing 
30 elements are implemented on a single chip while in other implementations all of 
or at least a portion of the I/O element is implemented on a separate computer 
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chip. Further implementations could also be possible. 

Persons skilled in the art will appreciate that there are alternative 
implementations and modifications of the present invention, and that the above 
5 described implementation is only an illustration of specific embodiments of the 
invention. Therefore, the scope of the invention should only be limited by the 
claims appended hereto. 
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